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Robust Recovery of Positive Stream of Pulses 

Tamil - Bendory 


Abstract —The problem of estimating the delays and ampli¬ 
tudes of a positive stream of pulses appears in many applications, 
such as single-molecule microscopy. This paper suggests estimat¬ 
ing the delays and amplitudes using a convex program, which is 
robust in the presence of noise (or model mismatch). Particularly, 
the recovery error is proportional to the noise level. We further 
show that the error grows exponentially with the density of the 
delays and also depends on the localization properties of the 
pulse. 

Index Terms —stream of pulses; sparse deconvolution; con¬ 
vex optimization; Rayleigh regularity; dual certificate ; super¬ 
resolution 


I. Introduction 

Signals comprised of stream of pulses play a key role in 
many engineering applications, such as ultrasound imaging 
and radar (see, e.g. [Q, 0, 0, J4[, Q). In some appli¬ 
cations, the signal under examination is known to be real 
and non-negative. For instance, in single-molecule microscopy 
we measure the convolution of positive point sources with 
the microscope’s point spread function ID, Q. ED- Another 
example arises from the problem of estimating the orientations 
of the white matter fibers in the brain using diffusion weighted 
magnetic resonance imaging (MRI). In this application, the 
measured data is modeled as the convolution of a sparse 
positive signal on the sphere, which represents the unknown 
orientations, with a known point spread function that acts as 
a low-pass filter (9), HOI . 

This paper focuses its attention on the model of positive 
stream of pulses. In this model, the measurements are com¬ 
prised of a sum of unknown shifts of a kernel g with positive 
coefficients, i.e. 

y[k] = T; c m g [k - k m ] + n[fc], k£Z, c m > 0, (1.1) 

m 

where n is a bounded error term (noise, model mismatch) 
obeying Unj^ := ^Sfcezl^MI < <)■ We do not assume any 
prior knowledge on the noise statistics. The pulse g is assumed 
to be a sampled version of a scaled continuous kernel, namely, 
g[fc] := g (-Jjj), where g(t) is the continuous kernel, a > 0 
is a scaling parameter and 1 /N is the sampling interval. For 
instance, if g is Gaussian kernel, then er denotes its standard 
deviation. The delayed versions of the kernel, g [k — k m \, are 
often referred to as atoms. We aim to estimate the set of delays 
{k m } C Z and the positive amplitudes {c m > 0} from the 
measured data y[fc], 
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The sought parameters of the stream of pulses model can 
be defined by a signal of the form 

x[fc] - = y ^ c m S [k , c m ]> 0, (1-2) 

m 

where 6[k] is the one-dimensional Kronecker Delta function 

s [k] ■■= 

In this manner, the problem can be thought of as a sparse 
deconvolution problem, namely. 



y [k] = (g* (x + n)) [k], 


( 13 ) 


where V denotes a discrete convolution and n[fe] is the error 
term. 

The one-dimensional model can be extended to higher- 
dimensions. In this paper we also analyze in detail the model 
of two-dimensional positive stream of pulses given by 


y[k] = (g 2 * (x 2 + n)) [k] , 

= X Cmg 2 [k - k m ] + n[k], 


(1.4) 


where k := [fci,fc 2 ] € Z 2 and g 2 is a two-dimensional pulse. 
As in the one-dimensional case, the pulse is defined as a 
sampled version of a two-dimensional kernel g 2 (fi,i 2 ) by 
g 2 [k] = g 2 (^, ^). The signal 


x 2 [k] := y jCm S[k-K 


> 0 , 


( 1 . 5 ) 


defines the underlying parameters to be estimated, where here 
6 denotes the two-dimensional Kronecker Delta function. For 
the sake of simplicity, we assume throughout the paper that 

(T iiVi = cr 2 iV 2 := crN. 

Many algorithms have been suggested to recover x from the 
stream of pulses y. A naive approach would be to estimate x 
via least-squares estimation. However, even if the convolution 
as in is invertible, the condition number of its associated 
convolution matrix tends to be extremely high. Therefore, the 
recovery process is not robust (see for instance section 4.3 
in DU). Suprisngly, the least-squares fails even in a noise- 
free environment due to amplification of numerical errors. We 
refer the readers to Figure 1 in lfT2l for a demonstration of 
this phenomenon. 

A different line of algorithms includes the well-known 
Prony method, MUSIC, matrix pencil and ESPRIT, see for 
instance 03, DU, ESI, 02), 03), ED- ®, (20). These al¬ 
gorithms concentrate on estimating the set of delays. Once the 
set of delays is known, the coefficients can be easily estimated 
by least-squares. These methods rely on the observation that in 


Fourier domain the stream of pulses model (1.1 1 reduces to a 
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weighted sum of complex exponentials, under the assumption 
that the Fourier transform of g is non-vanishing. Recent papers 
analyzed the performance and stability of these algorithms 
El], l22l . I251 . l24l . However, as the Fourier transform of 
the pulse g tends to be localized and in general contains small 
values, the stability results do not hold directly for the stream 
of pulses model. Furthermore, these methods do not exploit 
the positivity of the coefficients (if it exists), which is the focus 
of this work. 

In recent years, many convex optimization techniques have 
been suggested and analyzed thoroughly for the task super¬ 
resolution. Super-resolution is the problem of resolving signals 
from their noisy low-resolution measurements, see for instance 

11251 , El, E3, El- El, El- The main pillar of these 

works is the duality between robust super-resolution and the 
existence of an interpolating polynomial in the measurement 
space, called dual certificate. Similar techniques have been 
applied to super-resolve signals on the sphere OTI , [32], IflOl 
(see also El) and to the recovery of non-uniform splines 
from their projection onto the space of low-degree algebraic 
polynomials li34ll . 051 . 

The problem of recovering a general signal x (not nec¬ 
essarily non-negative) robustly from stream of pulses was 
considered in 03 . It was shown that the duality between 
robust recovery and the existence of an interpolating function 
holds in this case as well. Particularly, it turns out that robust 
recovery is possible if there exists a function, comprised of 
shifts of the kernel g and its derivatives, that satisfies several 


interpolation requirements (see Lemma III. 1 1 . In this case, the 


solution of a standard convex program achieves recovery error 
(in £i norm) of C* (g)<5, for some constant C*( g) that depends 
only on the convolution kernel g. In ll36] it was proven that the 
support of the recovered signal is clustered around the support 
of the target signal x. The behavior of the solution for large 
N is analyzed in detail in f37l . Ii38l . 

The main insight of 113 is that the existence of such 
interpolating function relies on two interrelated pillars. First, 
the support of the signal, defined as supp(x) := {t m } = 
{k/N : x[fc]^0}, should satisfy a separation condition of the 
form 

\U - tj\ > vo, Vti,tj G supp(x), i ^ j, (1.6) 

for some kernel-dependent constant v > 0 which does not 
depend on N or a. In the two-dimensional case, the separation 
condition gets the formQ 


||ti - tj|| > vo, t i,tj G supp(x 2 ), i j, 


and lit,—t,- 


(1.7) 


where t, = [t»,1,^,2] G 

max{|L;.i — tj, i|, \U t 2 — tj, 2 1}- The second pillar is that the 
kernel g would be an admissible kernel. An admissible kernel 
is a function that satisfies some mild localization properties. 
These properties are discussed in the next section (see Defi¬ 
nition II.3 1 . Two prime examples for admissible kernels are 
the Gaussian kernel g(t) = e - ^ and the Cauchy kernel 
g (t) = jj-jp. In lfl2l , the minimal separation constant v which 
is required for the existence of the interpolating function (and 

'Recall that we assume for simplicity that (J\N\ = <72:= aN. 


hence, for robust recovery) was evaluated numerically to be 
1.1 and 0.5 for the Gaussian and Cauchy kernels, respectively. 

Inspired by the recent work on super-resolution of positive 
point sources j39l , this work focuses on the model of positive 
stream of pulses. In contrast to 03 , we prove that in this 
case the separation condition is no longer necessary to achieve 
stable recovery. We generalize and improve the results of |f39l 
as discussed in detail in Section ITT] Particularly, we show that 
positive signals of the form < |I.2[ > can be recovered robustly 
from the measurements y ( |I.3| > and the recovery error is 
proportional to the noise level S. Furthermore, the recovery 
error grows exponentially with the density of the signal’s 
support. We characterize the density of the support using the 
notion of Rayleigh-regularity, which is defined precisely in 
Section [H] The recovery error also depends on the localization 
properties of the kernel g. A similar result holds for the two- 
dimensional case. 

We use the following notation throughout the paper. We 
denote an index k G Z by brackets [k] and a continuous 
variables t G 1 by parenthesis (t). We use boldface small 
and capital letters for vectors and matrices, respectively. Cal¬ 
ligraphic letters, e.g. A, are used for sets and _4 for the 
cardinality of the set. The I th derivative of g(i) is denoted as 
gW(£). For vectors, we use the standard definition of l p norm 
as ||a|| p := (X] fceZ |a [k] | p ) 1/p for p > 1. We reserve 1/N 
to denote the sampling interval of 0 and define the support 
of the signal x as supp(x) := {k/N : x[fc]^0}. We write 
k G supp(x) to denote some k G Z satisfying k/N G supp(x). 

The rest of the paper is organized as follows. Section [IT] 
presents some basic definitions and states our main theoretical 
results. Additionally, we give a detailed comparison with 
the literature. The results are proved in Sections [HI] and 
IV Section [V] shows numerical experiments, validating the 
theoretical results. Section |VI] concludes the work and aims to 
suggest potential extensions. 

II. Main Results 

In lH2l . it was shown that the underlying one-dimensional 
signal x can be recovered robustly from a stream of pulses y 
if its support satisfies a separation condition of the form ( |I.6| ). 
Following ll39l . this work deals with non-negative signals and 
shows that in this case the separation condition is not neces¬ 
sary. Specifically, we prove that the recovery error depends on 
the density of the signal’s support. This density is defined and 
quantified by the notion of Rayleigh-regularity. More precisely, 
a one-dimensional signal with Rayleigh regularity r has at 
most r spikes within a resolution cell: 

Definition II.1. We say that the set V C {k/N} keZ C R. 
is Rayleigh-regular with parameters (d, r ) and write V G 
7 Z ldx (d,r) if every interval (a,b) C K of length \a — b\ = d 
contains no more that r elements of V: 

\V n (a, 6)1 <r. (II.l) 

Equipped with Definition |II.1| we define the sets of signals 


1Z (d, r) := {x : supp(x) G ll idx (d, r)} . 
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We further let TZ+ (d, r ) be the set of signals in 7Z (d, r ) with 
non-negative values. 

Remark II.2. If r\ < r 2 , then 7Z(d,r \) C r 2 ). If d\ < 
d 2 , then 1Z (d 2 ,r) C 7 Z (di, r). 

Besides the density of the signal’s support, robust estimation 
of the delays and amplitudes also depends on the convolution 
kernel g. Particularly, the kernel should satisfy some mild 
localization properties. In short, the kernel and its first deriva¬ 
tives should decay sufficiently fast. We say that a kernel g is 
non-negative admissible if it meets the following definition: 

Definition II.3. We say that g is a non-negative admissible 
kernel if g (t) > 0 for all t £ R, and: 

1) g£ C 3 (R) and is even. 

2) Global property: There exist constants Cp > 0, l = 
0,1, 2,3 such that |gW(f)| < Cpf (l + f 2 ). 

3) Local property: There exist constants e, (3 > 0 such that 

a) g(t) < g(e) for all \t\ > e. 

b) g ^ 2 \f) < —f3 for all |t| < e. 


Now, we are ready to state our one-dimensional theorem, 
which is proved in Section III The theorem states that in the 
noise free-case, S = 0 , a convex program recovers the delays 
and amplitudes exactly, for any Rayleigh regularity parameter 
r. Namely, the convolution system is invertible even without 
any sparsity prior. Additionally, in the presence of noise or 
model mismatch, the recovery error grows exponentially with 
r and is proportional to the noise level. 

Theorem II.4. Consider the model (0 for a non-negative 
admissible kernel g as defined in Definition |//.J| Then, there 
exists v > 0 such that if supp(x) £ 7Z ldx (uo,r) and No > 


(I) 


A+i 


' , the solution x of the convex problem 

!;r subject to [|y - g * < 8, x > 0 , 


satisfies 


Hx-xHi < C(g,r,v)j 
where 7 := max {7 Vct,£ -1 } and 


(II.2) 


(II.3) 


C(g,r,v) :=4 r+1 (2 r - 1) 
6 z / 2 


g( 0 ) 


Co 


+ Qv 2 


3g (0) v 2 - 2 tt 2 C 0 


(II.4) 


Remark II.5. For sufficiently large // and TV, the recovery error 
can be written as 


: — x||, < C(g,r)(TVcr) 2 r (5, 


where C(g, r) is a constant that depends only on the kernel 
g and r. 

In order to extend Theorem 111.41 to the two-dimensional 
case, we present the equivalent of Definitions II. 1 and II.3 
to two-dimensional signals. Notice that the two-dimensional 
definition of Rayleigh regularity is not a direct extension of 
Definition |II.1| and is quite less intuitive. In order to prove 
we assume that the support of the 


Theorems 


II.4 


and II. 8 



Figure II. 1: This figure presents an example for a set of 
8 points that cannot be decomposed into 4 non-intersecting 
subsets that meet the separation condition as in 0 , although 
each resolution cell contains at most 4 points. Consider a 
square resolution cell (in sense) of size L x L. Note 
that indeed each resolution cell contains at most 4 points. 
Nonetheless, this set of points cannot be described as 4 non¬ 
intersecting sets that satisfy the separation condition. Specifi¬ 
cally, the distance (in norm) of the black point is smaller 
than L from the other 7 points, meaning it has to be in a 
separate subset from the others. On the other hand, there is 
no triplet of points that comprises a legal subset. Therefore, 
the property of Definition II .6 is not a consequence of the 
two-dimensional version of Definition 


II. 1 


signal could be presented as a union of r non-intersecting 
subsets, which satisfy the separation conditions of 0 and 
0 , respectively. In the one-dimensional case, this property is 
implied directly from Definition II. 1 However, this property is 
not guaranteed by the two-dimensional extension of Definition 
|II. 1 1 See Figure |II. 1 1 for a simple counter-example. Therefore, 
in the two-dimensional case the Rayleigh-regularity of a signal 
is defined as follows: 


Definition II.6. |f39l We say that the set V c 
{fci/TV, fc 2 /TV} fci fc2gZ C M 2 is Rayleigh-regular with parame¬ 
ters {d,r) and write V € TZl l 2 X (d,r) if it can be presented as 
a union of r subsets V=V\ U • • • U V r that are not intersecting 
and satisfy the minimum separation constraint 0 . Namely, 

• for all 1 < i < j < r, Vi C\ Vj = 0, 

• for all 1 < i < r, Vi satisfies: for all square subsets 
V £ R 2 of side length d x d, \ Vi IT D\ < 1. 

A two-dimensional non-negative admissible kernel is de¬ 
fined as follows: 


Definition II.7. We say that g 2 is a two-dimensional non¬ 
negative admissible kernel if g 2 (G,^) > 0 for all (G,^) € 

R 2 and it has the following properties: 

1) g 2 £ C 3 (R 2 ) and 

g 2 (ti, T 2 ) = g 2 (— ti, f 2 ) = g 2 (ti, —^ 2 ) = g 2 (—ti, ~h) ■ 

2) Global property: There exist constants Cp A t p 2 > 0 such 
that |g 2 ^ l/2) (ti,t 2 )| < ( i+ ^_’|y/ 2 , for h + £2 < 3, 

where g 2 (4>fe) (h,t 2 ) := ^^ 2 g 2 (ti,t 2 ). 

3) Local property: There exist constants /3, e > 0 such that 












































4 


a) g 2 (t 1 ,t 2 ) < g 2 (e, 0 ) for all (h,t 2 ) satisfying 
|fi| > e, and g 2 (h,t 2 ) < g 2 ( 0 ,e) for all 
satisfying \t 2 \ > e. 

b) g 2 (2,0) (fi,f 2 ) ,g 2 (0 ’ 2) (*i,* 2 ) < ~fi for all 

(ti,t 2 ) satisfying |ii|, \t 2 \ < e. 


h := x — x. 


Observe that by (II.2i 

21 


j is finite since 
||h||< llx)^ + Hxlh < 2 ||x||The proof relies on some 
fundamental results from DU (particularly, see Proposition 
3.3 and Lemmas 3.4 and 3.5) which are summarized by the 
following lemma: 


Equipped with the appropriate definitions of Rayleigh regu¬ 
larity and non-negative admissible kernel, we are ready to state 
our main theorem for the two-dimensional case. The theorem 


is proved in Section IV 


Theorem II. 8 . Consider the model 0 for a non-negative 
two-dimensional admissible kernel g 2 as defined in Definition 
II.7 Then, there exists v > 0 such that if supp(x. 2 ) £ 


(vcr, r), the solution x 2 of the convex problem 


min ||x|| x subject to ||y — g 2 * x^ < 6, x > 0 , 

(II.5) 

satisfies (for sufficiently large N and v) 

||x 2 - x 2 || x < C 2 (g 2 ,r) (Ncr) 2r 5, 

where C 2 (g 2 ,r) is a constant which depends on the kernel 
g 2 and the Rayleigh regularity r. 


To conclude this section, we summarize the contribution 
of this paper and compare it to the relevant previous works. 
Particularly, we stress the chief differences from E2, El 
which served as inspiration for this work. 

• This work deviates from l39l in two important aspects. 
First, our stability results is much stronger than those 
in (39). Particularly, our main results hold for signals 
with r spikes within a resolution cell. In contrast, the 
main theorems of ll39l require signals with r spikes 
within r resolution cells. Second, our formulation is not 
restricted to kernels with finite bandwidth and, in this 
manner, can be seen as a generalization of (39). This 
generalization is of particular interest as many kernels in 
practical applications are not band-limited. 

. In El, it is proven that robust recovery from general 
stream of pulses (not necessarily non-negative) is possible 
if the delays are not clustered. Here, we show that the 
separation is unnecessary in the positive case and can be 
replaced by the notion of Raleigh regularity. This notion 
quantifies the density of the signal’s support. 

• We derive strong stability guarantees compared to para¬ 
metric methods, such as Prony method, matrix pencil and 
MUSIC. Nevertheless, we heavily rely on the positiveness 
of signal and the density of the delays, whereas the 
parametric methods do not have these restrictions. We 
also mention that several previous works suggested noise- 
free results for non-negative signals in similar settings, 
however they do not derive stability guarantees El. go), 
JH, |H. In (43) it was proven that the necessary sep¬ 
aration between the delays drops to zero for sufficiently 
low noise level. 


III. Proof of Theorem III.4I 

The proof follows the outline of |39l and borrows con¬ 
structions from E2- Let x be s solution of and set 


Lemma III.l. Let g be a non-negative admissible kernel as 
defined in Definition II.3 and suppose that f := {t m } £ 
7 Z ldx (no, 1). Then, there exists a kernel-dependent separation 
constant v > 0 (see (1.6)) and a set of coefficients {a m } and 
{b m } such there exists an associated function of the form 


q 0 ) = E a ™ g 

m 

which satisfies: 


t tn 


l g 


( 1 ) 


t t r . 


(III.l) 


q((m) 

= 

1, 

q (*) 

< 

1- 

q (() 

< 

1 - 

q (() 

> 

0, 


tm £ T1 

fi(t~ tm) 


4g(0)cr 2 
fie 2 


4g(0) 

t £ R, 


1 1 tm | El7 , tm C f , 

\t - tm | > £ 0 -, Mt m £ T, 


where e and fi are the constants associated with g. Further¬ 
more, 

3z / 2 


l|b||, 


:= max a n 


:= max| 6 „ 


< 


< 


3g ( 0 ) u 2 — 27r 2 C 0 ’ 


7T 2 Cl 


(HI-2) 
(HI. 3) 


(3 |g( 2 ) (0)| v 2 - tt 2 C 2 ) (3g (0) v 2 - 27t 2 C' 0 ) 

Remark III.2. The non-negativity property, q (t) > 0 for all 
t £ R, does not appear in lfl 2 l . however, it is a direct corollary 
of the non-negativity assumption that g(f) > 0 for all t £ R. 

The interpolating function (III.l | > also satisfies the following 
property which will be needed in the proof: 


Lemma III.3. Let x be s solution of ( |//.2| ) and set h := x 
x. Let {Ti } l=1 be a union of r non-intersecting sets obeying 
% £ TZ ldx (ua, 1) for all i £ {1,..., r}. For each set f, let 
q, : [k] := q.j ( k/N ), k £ Z, be an associated function, where 
q, (f) is given in (III.l I. Then, for any sequence {cq }.| =1 £ 
{ 0 , 1 } we have 




i —1 


< 


+ C V 


C 0 

-4 


7 r" 
Gz ' 2 
li. 


6u 2 


3g ( 0 ) z / 2 - 2tt 2 Cq 


(HI-4) 


for some constant c* > 0 that depends on the kernel g. 

Proof: We begin by two preliminary calculations. First, 


we 


observe from (|I.3|> and (II. 2) that 


E 


Eg \ k ~ n ) h[/c] 




< l|y-g*x || 1 


< 


||g * X — ylli 
26. 


(III.5) 
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Additionally, we can estimate for all k G Z (see Section 3.4 definition, J\f C supp(x) and thus A f G 7 Z ldx (ycr, r). The 


in El) 


E 


fc m eTi 


;1 + (tvH 


< 2 ' 1 + 6^ 2 


set A/" can be presented as the union of r non-intersecting 
subsets J\f = Ul =1 J\fi, where N t = {ti,t i+r ,t i+2r , • ■ • } and 
Afi £ TZ ldx (vi r, 1). Therefore, for each subset A/i there exists 
an associated function q, [k] = q ( k/N ) as given in Lemma 


and hence with the properties of admissible kernel as defined |TTT- 1 1 The proof builds upon the following construction 
in Definition |II.3| we have for l = 0,1, 


E g< ° _ 

k m eTi 


< e 


i 


q[&] — ft q *M)- * 


(III.8) 


1 + (hhr) 


~ 2Ce{1 + 6^ 


(III.6) 


for some constant p > 0, to be defined later. The function q[fc] 
satisfies the following properties: 


According to ( |III. 1| >, the left-hand of ( |III.4| i can be explicitly 
written as: 


e n (q * w) h i fc ] 

/c£Z i= 1 

=e n e ~ km ii+^ g(i) ~ 


Lemma III.4. Let q be as in (III.8 1, let No > 
and let 

1 

P -2 


D 2 F + 1 / 0 

2) \ g(0) 


P 


h[Ar] • 


fc(EZ 2=1 


,eTi 


(IH-7) 


This expression can be decomposed into (at most) 2 r terms. 


4g(0)7 2 

where 7 := max {No, e _1 }. Then, we have 

q [^m] — Pi km C AT, 

q [k] > p, k £ J\f c , 
q [k] < 1 , fee Z. 

Proof: Since A/* € (z/cr, 1), by Lemma 


g(o) 

(HI.9) 


III.l 


there 


We commence by considering the first term of the expression exists for each subset A/i an associated interpolating function 

with 07 = a 2 = 1 and a* = 0 for i > 2 (namely, the product <T:W = q i(k/N). Consequently, for all k m £ N we obtain 

of the shifts of g). Using ( |III.5 1 and ( |III. 6 | > we get 

E E Q'mi § [k ^ ^ ^77128 


I h[fc] 


< 


fcez/c mi eTi 
11 n 2 


,eT 2 


E E g [/c h[Aj] E g t fc - k'pf 

ni £Ti k£Z km^Tl 

2 


q [ fc m] = H (i q [k m ]) - p 

i=l 

= ~P, 

and for all k £ J\f c we have 


< 2 IIall 7 ^ Cn ( 1 + 


< 4 llall" On 


7r 

6 z/ 2 

.2 


E 

nEZ 


Eg[ fc - 


fee z 


1 + ^ U ' 


q[&] = IIU-*!*])-' 

2=1 

P 

4g(0)7 2 


> 


P- 


By setting 


From the same methodology and using ( |III.2[ ), we conclude 
that for any sequence of coefficients {ai} i=1 £ {0,1} we get 

Eli ( E a m.iS[k- k mi ] | h[k] 

&EZ2=1 £71 

r— 1 


p ■= arg min q[fc] > - 
fee AA C 2 


/3 


4g(0)7 5 




6^ 


3g (0) v 2 - 2 tt 2 C 0 


6. 


Next, using (III.61 we observe that all other 2 r — 1 terms 


of (III.7» can be bounded by cq ||a| 


Pi 


\02 


for some 


constant Cq > 0 and 0 < /?i < r — 1, 1 < p 2 < r. Hence, 

we conclude by fTO) and (JTTO) that the summation of all To complete the proof, we need to bound the inner product 


these terms is bounded by c*rt _ ® ||h|| 1 for sufficiently large 
constants c* > 0 and v. The constant c* > 0 depends only on 
the kernel g. This completes the proof. ■ 

Consider x £ TZ + ( 00 , r ) and let us define the 
sets A f := {k/N : h[fc] < 0} and respectively N c := where 
{k/N : h[/c] > 0}. Throughout the proof, we use the notation 
k £ AC and k £ J\f c to denote some k £ Z so that 
k/N £ N and k/N £ N c , respectively. Observe that by 


we conclude the proof. Note t hat in order to guarantees p < 1, 
we require Ncr> (\) 2r+ \/j^ ■ ■ 

Equipped with Lemma III.4 we conclude that q[fc] and h[fc] 
have the same sign for all k £ Z, and thus 

(q» h > = E q W h [ fc ] = El q MH h MI 

fee z 

>p\Mi- 

eed to bou 

q, h) from above. To this end, observe that 

r 

U (i - q* [k]) = 1 + K r [k\, 


fee z 


(III. 10) 


(III.l 1) 


Kr [k] ~ EIK- q ^D 

j =1 t=1 


«<Ci) 


(III. 12) 
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for some coefficients {oti{j)Y i=1 £ {0,1}- For instance, 
k 2 [fc ] = —g i [k] - q 2 [ k ] + qi [k] q 2 [ k] . Therefore, by ( IIL8 1 
and (|II1. 11[) we get 


( q .h> = 


(III. 13) 


\i= 1 


= ((l-/ 0 )+«r,h) 

= (l-p)X! h [ fc ] + ( K r,h). 


ke z 


Recall that by (II.21 we have ||3c|| x < ||x||and therefore 


ll x lli > ll x + h lli = E l x [ fc ] + h MI 

fcGSUpp(x) 

+ E ! h [ fc ]l • 

fcez\supp(x) 

By definition h[/c] >0 for all k £ J\f c and we use the triangle 
inequality to deduce 

iixiii > e h t fc ] 

fcez\supp(x) 

+ E ( x t fc ] + h W) + E i x W + h wi 

fcGSUpp(x)\W fce N 

> ii x iii + E - E i h wi > 

fceV c 

and thus we conclude 


keM 


E h M - °- 


(III. 14) 


fcez 


So, from ((Dm}, dIlLT3| ), (1104) and Lemma [IIOI we con- 
elude that 


2 r — 1 

(q,h) < \(n r , h)| < E 

j=1 


EII(* [k]r u) Hk] 


< p-l)(C 0 [l + — 2 


60 


fcez z=1 

2 \ \ r-l 


,3g (0) v 2 -2tt 2 C 0 
+ c* (2 r - 1) ^ n^iir • 

Combining ( |III.15| l with ( |III. 10 1 and ( III.9| > yields 


u~ 4 ||h||! . (HI-15) 


Nr < 


(2 r -l)(Co( 1 + ^)) r " 1 ( 


6v 2 

3g(0)^ 2 —27 t 2 C 0 


2 ( 48 ( 0 ) 7 ^) c * (2 r !)' 

This completes the proof of Theorem |II.4| 


,-4 


IV. Proof of Theorem Iii.81 

The proof of Theorem |II.8| follows the methodology of the 
proof in Section [III] We commence by stating the extension 
of Lemma |III. 1 1 to the two-dimensional case, based on results 
from 1121 : 

Lemma IV. 1. Let g 2 be a non-negative two-dimensional 
admissible kernel as defined in Definition |//.i| and suppose 


that T 2 '■= {t m } £ 1Z 2 (no, 1). Then, there exists a kernel- 
dependent separation constant v > 0 and a set of coefficients 
an d {^m} such that there exist an associated 
function of the form 


q2 (t) = E°™S2 


t t n 




t ~ t r 

G 

t ~ t r 

G 


(IV.l) 


which satisfies: 

q 2 (t) = 1, t m £T 2 , 

, . lit — t m ||? 

qt < 1-C^- 

q(t) < i-c 2 , ||t-t m 

q (t) > 0 , 


|f tmlloo 5; trs 1 , t m £ r 2) 

L > £40-, Vt m e T 2 , 


for sufficiently small £1 < £ associated with the kernel g 2 , 
and some constants Ci,c 2 > 0. For sufficiently large v > 0 
and constants c a ,c b > 0, we also have 


= max a„ 


< 


1 


g 2 (0,0) 
< c b v 


+ C a V 


-3 


\b 2 1 " —“ 6 


: = max I b^ 

m 

We present now the two-dimensional version of Lemma 


III.3 without a proof. The proof relies on the same methodol¬ 


ogy as the one-dimensional case. 

Lemma IV.2. Let {70} r _ 1 be a union of r non-intersecting 
sets obeying Ti ,2 £ (ua, 1) for all i £ {1,... ,r}. For 

each set 71,2, let qr 2 [k] := qi. 2 (k/7V), k £ Z 2 , be an 


associated function, where qi. 2 (t) is given in (IV.l). Then, 


for any sequence {ct;}[ =1 £ {0,1} we have for sufficiently 
large v. 


e wr 

fee z 2 i=i 


h[/c] < C 2 (g, r)5 + c*v 


* —6 I 


(IV.2) 


-S. 


for some constants c* > 0 and C 2 (g 2l r) which depends on 
the kernel g 2 and the regularity parameter r. 

Let k £ Z 2 . Let us define the sets A/2 := {k /N : h[k] < 0} 
and Aff := {k/N : h[k] > 0}. Throughout the proof, we use 
the notation of k £ J\f 2 and k £ J\f 2 to denote all k £ Z 2 so 
that k/N £ N 2 and k/N £ A/'-jp, resp ectively. By definition, 
A/2 £ FL ldx (no, r) (see Dehnition II.61 and it can be presented 
as the union of non-intersecting subsets ff 2 = U[ =1 A//, 2 where 
A/i,2 £ 1Z l 2 x ( vo , 1). Therefore, for each subset A/i , 2 there 
exists an associated function q;, 2 [k] = qi. 2 (k/A r ) given in 
Lemma [IV. 1 1 As in the one-dimensional case, the proof relies 
on the following construction 


q2[k] ;= n (1 — q il2 [ k ]) - 


p , 


(IV.3) 


for some constant p > 0, to be defined later. This function 
satisfies the following interpolation properties: 
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Lemma IY.3. Suppose that 
No > max 


Cl ( \-i 

—)( £ l) : 

C2 


\M, 


where e\ is given in Lemma \IV.1\ Let q 2 be as in \IV.3\ and 
let 


1 

P ~2 


Cl 


{No) 


(IV.4) 


Then, 


q2 [k m ] = -p, k m e A/2, 

q 2 [k] > p, k£ W 2 C , 

q 2 [k] <1, ke Z 2 . 

Proof: Since A/i )2 £ 7£.2 dx (ucr, 1), by Lemma 


IV. 1 


there 

exists for each subset A/i )2 an associated function qr, 2 [A;] = 
qi. 2 (k/V). Consequently, for all k,„ g A2 we obtain 


q2 [k m ] = (i - qi, 2 [k m ]) - p=-p. 

i—1 

No > max | \J~%i (£i) _1 | we get for all k £ 


For 


q2[k] = 

i=l 

By setting 


Cl 


(NaY 


Cl 


P- 


p := arg min q 2 [k] > - , -^ , , 

k G Wf 1 “ 2 y (No) 2 ) 

we conclude the proof. The condition No > (|) 27 \/<P 
guarantees that p < 1. ■ 

Once we constructed the function q 2 [k], the proof follows 
the one-dimensional case. By considering Lemmas |IV2 and 
IV.3 and using similar arguments to (III. 10) and (III.151, we 


conclude 

P 11 h 11 ]_ < (q,h) < (3 r - l)C , 2(g2,r)<5 
+ c* (3 r — 1) is~ 6 ||h|| x . 

Using ( |IV.4) we get for sufficiently large v that 

||h|| 1 <C'2(g 2 ,r) (No) 2r 5, 

for some constant C 2 (g2, r) which depends on the kernel g 2 
and the Rayleigh regularity r. 


V. Numerical Experiments 

We conducted numerical experiments to validate the theoret¬ 
ical results of this paper. The simulated signals were generated 
in two steps. First, random locations were sequentially added 
to the signal’s support in the interval [—1,1] with discretization 
step of 0.01, while keeping a fixed regularity condition. Once 
the support was determined, the amplitudes were drawn ran¬ 
domly from an i.i.d normal distribution with standard deviation 
SD = 10. For positive signals, the amplitudes are taken to be 
the absolute values of the normal variables. 



Figure V.l: Example for the recovery of a signal of the form 
of ( |L2) from stream of Cauchy kernels with 0 = 0.1, Rayleigh 
regularity of r = 2, separation constant of v = 0.5 and noise 
level of 5 = 75 (SNR=27dB). 


0.15 

0.1 


O original signal 
+ recoverted signal 


0.05 


* 


0 - # 


*0 




-0.15 


Figure V.2: An example for the recovery of a two-dimensional 
signal of the form ( |1.5) from the measurements ( |L4) , with 
r = 2, S = 400 and v = 0.8. The figure presents merely the 
locations (support) of the original and the recovered signals. 


The experiments were conducted with the Cauchy kernel 


g (t) = 


i+ur 


o = 0.1. We set the separation constant to 


be v = 0.5, which was evaluated in Gl to be the minimal 
separation constant, guaranteeing the existence of interpolating 
polynomial as in Lemma III. 1 1 Figure [VT| presents an example 
for the estimation of the signal ( |I2) from with r = 2. 
As can be seen, the solution of the convex problem (II.2) 
detects the support of the signal with high precision in a noisy 
environment of 27 dB. Figure |V2] presents an example for 
recovery of a two-dimensional signal from a stream of Cauchy 
kernels with r = 2 and v = 0 .8. 


Figure V.3 shows the localization error as a function of 
the noise level <5. To clarify, by localization error we mean 
the distance between the support of the original signal and 
the support of the recovered signal. Figure [V3a| compares the 
localization error for positive signals and general real signals 
(i.e. not necessarily positive) from stream of Cauchy pulses. 













































For general signals, we solved a standard minimization 
problem as in fl2l . which is the same problem as ( |II.2| > without 
the positivity constraint x > 0. Plainly, the localization error of 
positive signals is significantly smaller than the error of general 
signals. Figure V.3b| shows that the error grows approximately 
linearly with the noise level 5 and increases with r. 


VI. Conclusions 

In this paper, we have shown that a standard convex 
optimization program can robustly recover the sets of delays 
and positive amplitudes from a stream of pulses. The recovery 
error is proportional to the noise level and grows exponentially 
with the density of signal’s support, which is defined by the 
notion of Rayleigh regularity. The error also depends on the 
localization properties of the kernel. In contrast to general 
stream of pulses model as discussed in G2, no separation 
is needed and the signal’s support may be clustered. It is of 
great interest to examine the theoretical results we have derived 
on real applications, such as detection and tracking tasks in 
single-molecule microscopy. 

We have shown explicitly that our technique holds true 
for one and two dimensional signals. We strongly believe 
that similar results hold for higher-dimension problems. Our 
results rely on the existence of interpolating functions which 
were constructed in a previous work 03. Extension of the 
results of (33 to higher dimensions will imply immediately 
the extension of our results to higher dimensions as well. 

In If36l . it was shown that for general signals that satisfy the 
separation condition © the solution of a convex program 
results in a localization error of order \/S. Namely, the support 
of the estimated signal is clustered around the support of the 
sought signal. It would be interesting to examine whether such 
a phenomenon exists in the positive case as well. 
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(a) Mean localization error of positive signal and general signal (not (b) Mean localization error of positive signals for r = 2,3,4. 
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Figure V.3: Mean localization error from a stream of Cauchy pulses as a function of the noise level (5. For each value of S , 50 
experiments were conducted. 
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